Statistical Physics of Information Processing in Mobile Communications

Statistical Physics for Communications , Signal Processing , and Computer

Array Processing for Mobile Communications

Statistical Physics and Information Theory

This is a set of lecture notes for a graduate course, which focuses on the relations between Information Theory and Statistical Physics. The course is aimed at EE graduate students in the area of Communications and Information Theory, as well as to graduate students in Physics who have basic background in Information Theory. Strong emphasis is given to the analogy and parallelism between Inform...

Information Theory and Statistical Physics

Relationships between information theory and statistical physics have been recognized over the last few decades. One such aspect is identifying structures of optimization problems pertaining to certain information-theoretic settings and drawing analogy to parallel structures arising in statistical physics, and then borrowing statistical mechanical insights, as well as powerful analysis techniqu...

Algorithmic information and simplicity in statistical physics

Given a list of N states with probabilities 0 < p1 ≤ · · · ≤ pN , the average conditional algorithmic information Ī to specify one of these states obeys the inequality H ≤ Ī < H + O(1), where H = − pj log2 pj and O(1) is a computer-dependent constant. We show how any universal computer can be slightly modified in such a way that the inequality becomes H ≤ Ī < H + 1, thereby eliminating the comp...